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1. This form, when completed, should oe brought or sent to the Patent Office together with the 
prescribed fee and two copies of the description of the invention, and of any drawings. 

2. Enter the name and address of each applicant. Names of individuals should be indicated in full 
and the surname or family name should be underlined. The names of all partners in a firm must be 
given in full. Bodies corporate should be designated by their corporate name and the country of 
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3. Where the applicant or applicants is/are the sole inventor or the joint inventors, the declaration (a) 
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is not the case the declaration (a) should be struck out and a statement will then be required to be 
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4. If the applicant has appointed an agent to act on his behalf, the agent's name and the address of 
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ADP Code No. (if known) in the box provided. 

5. An address for service in the United Kingdom to which all documents may be sent must be 
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6. The declaration of priority at VII should state the date of tye previous filing and the country in 
which it was made and indicate the file number, if available. ' !| 

7. When an application is made by virtue of section 8(3). 12(6), 15(4) the appropriate section 
should be identified at VIII and the number of the earlier application or any patent granted thereon 
identified. 

8. Attention is directed to rules 90 and 106 of the Patent Rules 1982. 

9. Attention of applicants is drawn to the desirability of avoiding publication of inventions relating to 
any article, material or device intended or adapted for use in war (Official Secrets Acts. 1911 and 
1920). In addition after an application for a patent has been filed at the Patent Office the 
comptroller will consider whether publication or communication of the invention should be prohibited 
or restricted under section 22 of the Act and will inform the applicant if such prohibition is 
necessary. 

10. Applicants resident in the United Kingdom are also reminded that, under the provisions of 
section 23 applications may not be filed abroad without written permission or unless an application 
has been filed not less than six weeks previously in the United Kingdom for a patent for the same 
invention and no direction prohibiting publication or communication has been given or any such 
direction has been received. 



1 0 ( ^ ^f- . 8 j Rosser, PEB 9/1/90 

Audio Enhanced Ele ctronic Billboard. 

This invention relates to the display of messages and images, especially 
advertising, on video or television media, and especially to the enhancement of 
slogans or advertising artificially added into the visual stream by making the 
image respond to sound from the original scene. 



An Electronic Billboard is a means of adding images, messages or 
slogans to preexisting video images in such a way that they appear to be part of 
original image, as described in British Patent Application 9003275.6, of 
February 14th, 1990 by R. Rosser and M. Leach. This addition can be done in 
two ways - either by "chromo-key" techniques in which a region of a particular 
colour or pattern is recognized and written over, or by the identification or 
recognition of particular features in a scene, such as the goal posts in an image 
of a soccer match. These features would be used to locate the position, size and 
perspective of an artificial electronic billboard, which would be added to the 
video image and appear to the end user as if it were part of the original scene. 

The potential uses of such a system include advertising, especially (but 
not exclusively) in sporting events such as soccer or rugby where there is 
continuous action. By making the advertising a discrete part of the action, the 
game would not have to be interrupted. Additionally, the message could be 
changed during the game, it could be animated and it could be different for 
different target audiences. 

This invention enhances such a system by allowing the inserted video 
image react to some aspect of the original scene, such as the sound. For 
instance, the inserted slogan could change colour, vibrate or move as the 
sound level from the stadium reached a certain level. Or it could have a colour 
which was related to the sound level, a colour "thermometer" of the sound level. 
In a move sophisticated version, the image change may be keyed to recognition 
of a particular word by the commentators. For instance the slogan could change 
when a particular player - or team or when the product name - is mentioned. 

Such a system will greatly enhance the effectiveness of electronic 
billboard advertising by linking visual and audio ques. With the development of 
the appropriate technology the concept can be extended to include visual 
enhancement of the visual pattern. For instance a sophisticated pattern 
recognition system may recognize the presence of a particular player and use 
that to animate or change the inserted image in some suitable fashion. 
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A specific embodiment of the invention will now be described with 
reference to the attached drawings in which :- 

Figure 1 is a schematic view of the electronic billboard with audio 
enhancement. 

The television camera 10 records an image of a scene 12, which may be a 
tennis match. The video signal, which may be in any format, is then analyzed by 
computer 14, which in real time, using pattern recognition algorithms, 
recognizes specific marking on the court, such as the tramlines. Using these 
markings to scale size, position and perspective, a slogan, icon or image is then 
added to the video signal from a separate source 1 6, which may be another 
camera or computer or other electronic device, so that when displayed on the 
end users television set 18, the slogan or added image appears to be a part of 
the original scene. It can be made to appear as part of the background by only 
allowing it to key over specific colours or range of colours, such as the colour of 
the court in a tennis match. (Or by not keying over specific colours, such as the 
clothing and flesh colours of the players). Background may also or alternatively 
be identified by noise, contrast, or other characteristic of the original image. The 
resultant effect would be to have an unimpeded view of the match, with 
advertising discretely, yet conspicuously added. The principle could be 
extended to use numbers, and other objects as cues as to where to locate the 
electronic billboard. 

In addition the audio from the scene 12 is recorded by microphones 20 
and added to the broadcast stream in the usual fashion. However by linking a 
suitable audio processor 22 into the audio stream from the microphone 20, the 
sound can be used to control some aspect of the image inserted by the insertion 
device 16. In the simplest embodiment the audio processor 22 would only 
respond to the total volume form the microphone 20, and alter the added logo 
according to that. For instance the colour of the logo could be keyed to the 
sound level, or the logo could be made to vibrate when the sound intensity 
reached a certain threshold. This could all be done by software control of 
microprocessors or by suitable electronic hardware. In a more sophisticated 
version, the audio processor 22 could be a voice recognition system, as are 
becoming routinely available. This would recognize, for instance, particular 
words spoken by say the commentator, and make the inserted video respond in 
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a suitable fashion. For instance, the logo could change colour, do a flip, vibrate 
move or other wise change whenever the name of a particular player, team or 
even the product being advertised was mentioned by the commentator. It could 
even respond to particular words or phrases likely to be uttered by the 
commentator. 
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